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CENTRAL INTELLIGENCE AGENCY 


WASHINGTON, D.C. 20505 


26 November 1979 


mp. ~L. Sceantlebury 

Director, Financial and General Manaqcement 
Studies Division 

United States General Accounting Cffice 

Washington, D.C. 20548 


Rear Sir: 


Fnclosed you will find the completed questionnaire 
contained in your letter of 23 October 1979, I hope you 
find the information useful. 


Tn analyzina the answers provided in the questionnaire, 
one aualification shoulda be noted. Applications programming 
is done in this Agency on ouite a Cecentralized basis. 

The orcanization which I represent within CIA is only one, 
although the laraest, applications organization anc represents 
only about 35-40% of the applications work done in the Agency. 
Subseauently, while the response to questions 5, ®, and 9 
represent only my qroup, the other responses will, in my 
opinion, roughly apply throughout the Aqency. 


Should you have a uestions, please feel free 
STATOTHR to call me directly aia 


STATINTL 
Reputy fe ae ee APyLications 


Office of Nata Processing 


Fnelosure: 
Survey Questionnaire on Applications 
Software Maintenance 
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UNITED STATES GENERAL ACCOUNTING OFFICE 


WASHINGTON, D.C. 20548 


October 23, 1979 


Central Intelligence Agency 
Proc. Div. 
Washington, DC 206505 


Dear Sirs: 


The U.S. General Accounting Office, an agency of the 
Congress, is currently studying Federal agencies' management of 
applications software maintenance. As part of our study we are 
interested in learning of the extent and nature of software and 
software maintenance at Federal data processing installations. 
We would also like to obtain the views of knowledgeable Federal 
Gata processing professionals on these subjects. 


To obtain the needed information and views, we have 
developed the enclosed questionnaire, which we would like to 
have completed by ADP managers or senior level staff at your 
installation. 


Questionnaire responses will be reported in summary form. 
Although we are requesting identifying information, we are 
doing so solely to enable us to obtain clarifying information, 
if necessary, and to supply copies of our report to those who 
reguest them. Also, we may visit selected installations to 
augment information on the questionnaire but our intent 
nonetheless is to present all information obtained in summary 
form. 


We would very much appreciate it if you would return the 
completed questionnaire in the enclosed envelope within 10 
days. If you have any questions, please call Mr. John Womble 
telephone number: (465) 686-2223 or FTS 732-2223, or Dr. 
Steven Merritt: (202) 275-6187 or FTS 275-6187. 


Thank you for your cooperation. 


Sincerely yours, 


Pe ee ag etre one 
D. L. Scantlebury a 


Director, Financial and General 
Management Studies Division 


Enclosures 
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U. S. GENERAL ACCOUNTING OFFICE 


SURVEY OF 
APPLICATIONS SOFTWARE Hs 
MAINTENANCE (1-4) 


INTRODUCTION 


This questionnaire seeks information about 
Federal agencies’ management of their applications 
software maintenance. The questionnaire should be 
completed at the installation level by ADP managers 
or senior staff members knowledgeable about appli- 
cations software maintenance. If the address to 
which the questionnaire has been sent is not a data 
processing installation, please forward it to your 
organization's data processing division. 


Most questions can be answered by simply 
checking a box or writing in a small amount of in- 
formation. Where exact answers are not readily 
available, please provide the best available estimate. 
If you wish to explain or amplify any answer, please 
de so at the end of the questionnaire. 


The information we ask about the respondent is 
needed for follow-up purposes. Answers will gener- 
ally be reported in summary form. Individuals will 
not be associated with specific answers. 


Please return the questionnaire as soon as 
possible in the envelope provided. If you have any 
questions, please call Mr. John Womble on (405) 
686-2223 or FTS 732-2223, or Dr. Steven Merritt on 
(202) 275~6187 of FITS 275-6187. 


NOTE: In completing this questionnaire, 
please ignore the numbers in parentheses 
to the right of a question item; they 
are included to facilitate keypunching. 


RESPONDENT INFORMATION 


STATINTL 
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Part I Applications Software Maintenance 


DEFINITION 


For purposes of this questionnaire, we have 


definedapplications software maintenance as 


follows: 


any actions taken after implementation 


of the software to 


1) remove defects in the software including 


a) defects in which the software was 
programmed to do something other than 
what the user wanted, and 


b) defects in which the program logic was 
faulty with the result that the program 
did something other than what the 
programmer intended 


2) tune the software to make it more efficient 
(less machine time and/or less core) 


3) modify or enhance the software to make it 
perform more end-user functions, including 


a) functions originally called for in the 
system design, but not implemented, and 


b) new functions requested by the user not 
called for in the original system design 


4) make other modifications resulting 
from miscellaneous causes such ag the need 
to interface with other systems, system 
software changes, etc. 


NOTE: We are aware that each agency may 
define software maintenance differently. 
Regardless of your agency's definition, 
please answer our questions in terms of 
all the functions included in our definitic 
above. This is necessary to ensure con- 
sistency in responses. 


Does your installation have responsibility for 
any applications software maintenance as defined 


above? (5) 
1. [7 Yes 


2. {7 No (L£ no, please explain below and skip 
to question 6.) 


RS ORNL: = A RL ent eerie iin ane eet 


ae re mete 


eet: sete A ha me AE 


A APMEN EEN RENAE LIT LE, 
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Which of the following beet describes the extent 
of your installation's software maintenance 
responsibilities? (Please check only one.) (6) 


L. fs, ‘Limited ~ Congists solely of identi- 
fying defects, new user requirements, 
trouble shooting, and installing 
changes for applications developed by 
a central agency function outaide 
this installation 


25 Ey Limited maintenance on centrally de- 
veloped applications, plus maintenance 
on some locally developed systems 


Bef 7 Full maintenance responsibility for 
all applications run at thie 
inetallation 


4, fit Other (Please describe.) 


Leann en ec ee ceeiatinenipem chia amamu astra acne er stemstees tena tencementesneasiauniatael 


Ie the applicationa software maintenance at your 
installation performed by installation employees, 
by contractor employees or by a mixture of both? 
(Please check only one.) (7) 


1. f ay Installation employees do all applications 


software maintenance 


2, /_/ Contractor employees do all the appli- 
cations software maintenance 


3. LS7 Applications software is maintained by 
a mixture of installation employees and 
contractor employees 


4. /{ / Other (Please describe.) 


ee ee TONE NI ELT TER FEO OE 


CPU ti 
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Please show the percentage of total software 
maintenance (as measured by staff hours) per- 
formed at your installation that falls in each 
of the following categories. Show a percent 


for each category (even if it ie zero percent). 
Percents shown should add to 1004. 


Any actions taken after imple- 
mentation of the software to: 

1. Remove defects in the software, 
including 


@) defects in which the software 
was programmed to do something 
other than what the user 
wanted 


1% (8-10) 


b) defects in which the program 2) % (11-13) 
logic was faulty with the 

result that the program did 

something other than what 


the programmer intended 


we 


b 
2. Tune the aoftware to make it ? (14-16) 
more efficient (less machine 


time and/or lese core) 


3, Modify or enhance the software 
to make it perform more end- 
user functions, including 


a) functions originally called for f 0% (17-19) 
in the system design, but not 
implemented 


b) new functions requested by the box (20-22) 
user not called for in the 
original system design 
4, Make other modifications 1 % (23-25) 
resulting from miscellaneous ; 
causes such as the need to 
interface with other systema, 
system software changes, etc. 


100 % Total 


Please estimate the percentages of the following 
resources’ times that are devoted to the soft- 
ware maintenance functions listed in question 

4. Please show a percentage for each item even 
if it is zero. 


A. Personnel 


Programmer /analyst AG % (26-28) 
Operations personnel ©O.% (29-31) 
| Administrative personnel © % (32-34) 
Management personnel Ags (35-37) 
B. Hardware 
we 
) % (38-40) 


P| 
SN Yh 
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6. Are the applications programs in use at your 7. Do most of the application programs in use at 
installation primarily business applications, your installation run in production for a year or 
primarily scientific applications, or a mix- , more before being discarded or replaced; do most 
ture of both business and scientific applica- run for leas than a year; is the number running for 
tions? (Please check only one.) (41) a year or more about equal to the number that run 


for less than a year? (Please 'check only one.) 


1. ful Primarily business applications : 
aes, : Ph Most run.for.a year or more 
2. / / Primarily scientific applications 

musi 2 2. yames Most run for less than ae year 
3. Bas mixture Of business and acientific 


applications 3, f 7 About as many last a year or more as 


Sp last less than a year 
4. jf _/ Other (Please describe.) 


pee sence eet 
a Ait REND NI EN 


emcee 


tence emer te 


&. Next we are interested in the programming languages used in your installation. Please state for each of 
the languages listed below the number of application programs in that language currently in use in your 
installation and the average production life in years at your installation of the application programs 


in that language. 
" 


No. of programs Average length of production 
whose source code life'of programs in the 
LANGUAGE is in the language Language in years _ 


CORDES oo aS Le Ge | 0/0; (43-47) eel tar Pee: 1181 4-49) 


roman ft SOY “ors at st 


ryt OD 7-60) AF se) 
pastc Oy 63-66) C6768) 
FACS eae a eee RSE OOS AE AY (1) NR ACR RRL RO NT A A) 
; Gels 4) 
assempuye A OY ey 8) (9-10). 
CL ON er Ky A eS 2) SE aOR ORY BL 7) 
ee ee co ee ee 
LISP se NE we rhe oP hf Ua ae Sh ao IR nf ORO 
SIMSCRIPT A dQ) to) 
Ss ee MM ROY eB Ea HSC) SS en ae? eC) Me 
DYNAMO, Pf 47-50) haste hl PASTSD oo 
SNOBOL EF Pf ene | Lf 7-58) 
SCORE / tif fd 659-62) ee ee LOT CE Oe 
EASY-TRIEVE f/f A dd 65-68) oe ee ae =70) 
pynzeo et) sg” 
, | Seis) , 
DATA BASE Lancuaces WY OO) 5-8) dB (8-10) 


OTHER (Specify) 


ee eae er er ig Se eae fees Cad ed AIO 


* Assembly Teasuaees include BAL, "EASYCODER, {, AUTOCODER, GMAP, COMPASS, « etc. 
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(42) 
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9, Please write in the age (i.e., how long it has been in production) of the oldest a lication program 


in use at your installation. Write in your estimate. 


ers ee years (17-18) 


G. In what language ia the oldest application program in use at your installation written? (Please check 
only one.) / (19) 


de LT COBOL 2. 4) Assembly language* 3. f7] FORTRAN 5. {7 Other (Please specify.) 


mom 


ORANG, A nse 


* ASSEMBLY LANGUAGES INCLUDE BAL, EASYCODER, AUTCCODER, GMAP, COMPASS, etc. 


A al ES IR OS AOA Acne nm 


iL. Which, if any, of the following software tools and techniques are in use at your installation? (Please 
check all that apply.) 


Too Technique 
1. {77 automated documentation (20) 1. aa Code arrangement (28) 
2. [7 Source text manipulation (21) 2. {7 Descriptive documentation (29) 
3. [Program optimization (22) 3. {7 Performance documentation (30) 
4. {Lf Aide built into compilere (23) 4, Lo ‘Embedded documentation (31) 
5. fi Special programming languages 5. LP vecgeiiedling practices standarda (32) 
_ ecompilere (24) 6 

A 6. LF Re-use of already written code (33) 

6. {“/ Preprocessora (25) 
7, f7 Quality sssurance organization/ 

7. Ly Program performance evaluation (26) management (34) 
8. £7 Design language (27) 8. { WF Design (35) 


9. {7 Programming organization/management (36) 


*» Does your inetellation have an on-going (coguler basis) effort to do optimization on application programs 
Pp 


to reduce the machine costs of running them ease check only one.) (37) 
; iy 
1, tat Yes 2. ae | No 3. fa Not sure 


‘> Are cost accounting procedures in effect at your inatallation to capture pergaonnel, hardware, and over- 
head cost associated with application software maintenance ae defined in this questionnaire? (Please 


chack only one.) (38) 
tL, | Yea 2. Li No 3. 7 ae Not sure 

» If yee, are reports showing these costs regularly produced? (Please check only one.) (39) 
1. Yea 2, ("7 No 3. {7 Not applicable - no procedures 


Please attach a sample sheet from such a report showing cost elements reported, if one ia 
available, 


ct IIL Opinions and Views 


3. Based upon your experience, do you believe that application software developed by contractors requires 
more ox less maintenance than application software developed in-house? (Please check only one.) (40) 


1. of 7. Contractor-developad software requires more maintenance 
2. ¢ 7 Contractor-developed software requires about the same amount of maintenance 
3. f 7 Contractor-developed software requires less maintenance 


a” 
4, aa a No opinion 
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16. 


17. 


18. 
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In your opinion, which, if any, of the follow- 
ing actions would result in the greatest reduc~ 
tion in the size of the government's applications 
software maintenance effort? (Please check only 


one.) (41) 

1. / 7 Better definition of user require- 
ments in the system development stage 

2. / / Better definition of user require- 
ments for modifications to existing 
software 

3, f / Use of software tools and techniques 
in system development (tructured 
design, structured coding, etc.) 

4, f 7 Providing better toola and techniques 
for maintenance programmers (auch as 
jateractive terminals, text editors, 
and program analysis tools, etc.) 

5, / 7 More thorough testing of applications 
programs before the system ia re- 
leased to production 

6. / 7 Eliminating unnecessary changes re~ 
quested by users 

7. [7 Nothing-such a reduction is not 
possible 

8. fel Other (Please specify.) 


Does the definition of software maintenance used 
in thie questionnaire generally agree with your 


agency's definition? (42) 
1. [ves 
2. {7 No 


4. f/ 7 Not sure 


If not, briefly state your agency's definition. 
(43) 


rer eer ee A CL CCL CC 


19, If you have any additional comments on any 

of the questions in the questionnaire or on 

any other aspect of software maintenance, 

please provide them in the apace below. If 

you would prefer to convey your views separately, 


please write: 


Mr. John Womble 
U. §. General Accounting Office 
200 N. W. 5th, Room 348 


Oklahoma Gity, Okiahoma 73102 


or 


Dr. Steven Merritt . 

U. §. General Accounting Office 
441 G Street, N.W. 
Washington, D. C. 20548 


Attn: FGMSD, Room 6011 


or call them. Their telephone numbers are 


Listed on page 1 of the questionnaire. Thank 
you for your cooperation. Pg 


5 
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UNITED STATES GENERAL ACCOUNTING OFFICE 


WASHINGTON, D.C. 20548 


en aaa 
: Ii STATINTL 


ec Z Mo 


October 23, 1979 


Central Intelligence Agency 
Proc. Div. 
Washington, DC 20505 


Dear Sir: 


The U.S. General Accounting Office, an agency of the 
Congress, is currently studying Federal agencies' management of 
applications software maintenance. As part of our study we are 
interested in learning of the extent and nature of software and 
software maintenance at Federal data processing installations. 
We would also like to obtain the views of knowledgeable Federal 
data processing professionals on these subjects. 


To obtain the needed information and views, we have 
developed the enclosed questionnaire, which we would like to 
have completed by ADP managers or senior level staff at your 
installation. 


Questionnaire responses will be reported in summary form. 
Although we are requesting identifying information, we are 
doing so solely to enable us to obtain clarifying information, 
if necessary, and to supply copies of our report to those who 
request them. Also, we may visit selected installations to 
augment information on the questionnaire but our intent 
nonetheless is to present all information obtained in summary 


form. 


We would very much appreciate it if you would return the 
completed questionnaire in the enclosed envelope within 10 
days. If you have any questions, please call Mr. John Womble 
telephone number: (405) 686-2223 or FTS 732-2223, or Dr. 
Steven Merritt: (202) 275-6187 or FTS 275-6187. 


Thank you for your cooperation. 


Sincerely yours, 


Ot Neath 
ots ef 


D. L. Scantlebury 
Director, Financial and General 
Management Studies Division 


~ 


Enclosures 
569 
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TRANSMITTAL SLIP 


BUILDING 
Hdqs. 


REMARKS: 


ti O64 me 1/r8 


DD/A/ODP 


FORM NO . REPLACES FORM 36-8 
{FEB 55 241 WHICH MAY BE USED. m 
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STATINTL 


